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SVIAGE PROCESSINiG 
This invesntion lelates to an image processing orinampiilationtechniqu and in 
particular to a technique that may be used to enhance our appreciation of 3D depth 
and form depicted in base 2D images and derivative virtual realily (VR) 
5 environments. 

When tihffee-dimensional scenes are displayed or depicted usiag conventional 
two-dimensional techniques, for example by printing on to paper or the like or 
displaying on a television, computer monitor or die like, or by projection, although die 
brain perceives the images displayed as being three-dimensional, there are occasions 

10 wbm the perception of depth in the display^ed image is not particularly good. This is 
thought to be due to the absence of suf&cient depth cues in the image to allow the 
brain to interpret the displayed image fully. 

The technique of the invention has been developed firom theoretical work 
identifying a new form of illusionaiy space ^^diich has beea termed 'mental 

15 projection' . By correctiy representing and aligning two projections used by the brain 
to compose mental images it is possible to induce the brain to replicate depth and 
form perceptions that could otherwise only be created by directly observing the 'real 
setting' from which the pictorial information derived. 

'Mental Projection' can be achieved/ induced in a number of ways pictorially. 

20 



1. By imbuing traditional picture space (perspective projection or 
photographic/ fihn record) with the required cues. 

2. By using the principles to estabUsh a new picture/ model space to generate 
novel virtual reality (VR) environments. 

5 It is an object of the invention to provide a system, which may be used in 

combinstian with existing techniques, whereby an image may be created or modified 
to enhance the perception of the depth in die image. In each case, mental projection 
relies on the incorporation of stimuH from which the brain is able to deduce additional 
perceptions of depth and form associated with om: sense of visual perception. 

10 Accordingtooneaspectoftheinventionfliereisprovidedanimageprocessing 

technique comprising the stq)s of: 

(a) stretdiinglheoiigii^imageinflieY-diiectionbyafectDrfe^ 

the range of 2-7%; 

selecting a fixation point and disordering the image centring the disordering 

15 operation around the fixation point; and 

rotating the image through an angle felling wifliin the range 3-9° ^ 

(b) stretching a copy of the original image in the X-direction by a factor 

falling within the range of 2-7%; and 

selecting an area of the image aroimd the selected fixation point; and 
20 (c) merging the selected area of tiie image fonned in step (b) with the image 

fonned in step (a). 



The image foimed as a result of the transfoimatioii set out in step (a) will 
hereinafter be referred to as a Type 1 image, and tliat produced in the transformation 
set out in step (b) will be referred to as a Type 2 image. 

This technique can be thus be used to: 

i) mimic Ae appearance of the two base projections used by tiie brain in our 
projection of the real world by transforming known picture environments. 

ii) replicate a typical composition/ stinicture of tiiese base projections used by 
tiie brain to form menial images. 

The key to forming a valid composition is the selection of a jSxation point, the 
establishing of a jBxation area and the correct imposition of conditions prevailing in 
*l3ie fixation volume' and around the interface between the image types. As in real 
time observation, a fixation point needs to be established on tiie media. The fixation 
point is the point around which the various transformations techniques are to be 
centred. It is thought that tihe enhanced 3D depth and form cues are establishedby the 
brain as it makes relativistic judgements between tiie information contained within the 
two image types. Without a central point of aUgnment (fixation point) firomboth data 
sets, it would be impossible to make tiiese calculations. The fixation area estabUshes 
an area around tiie fixation point broadly analogous to tiie extent of cential vision. 
As such, the fixation area estabUshes tiie extent of the image to be subjected to tiie 
specific conditions of tiie fixation volume. The fixation volume is a spherical area of 



mnenoe contamed mto Hie fixation area. Any form (object), surface or part of a 
form that projects into this area of influence is projected in tHe brain as per liie 
qualitative and quantitative characteristics of image type 2 above. 

It follows that any other visual reference to objects outside of tins fixation 
volume contained in tiie fixation area are referenced as per tHe image type 1 above. 



fi^jration volume are referenced as per the 



Areas of central vision outsiue tuC juxa«on 
characteristics of 'peripheral vision'. 

Hiere are a number of typical compositions used by tiie brain ^vhich utilise 
aspects and juxtapositions of tiie two hnage types in a way capable of generating tiie 
relativistic judgements from which tiie new cues are deduced. 

Images processed in tiiis manner are tiiought to conform more fully witii our 
projection of real-time observations (mental images) allowing tiie brain to corxectiy 
interpret afidler range of tiiree-dimensional cues fromtiie 2D image or virtual reality 

setting. 

TTie processing technique may include an additional step of fine tuning tiie 
boundary between tiie images formed in steps (a) and (b). 

Step (a) of tiie processing technique may fiirflier include steps of altering tiie 
coloursaturationbyafactorfal]ingwitiiintiierangeof20-6Go/oand/ord 

brightness of tiie image by a factor falling witiiin tiie range 10-50%. 

me technique defined hereinbefore may be performed using a computer on 
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image data derived, for example, from a seamier or digital camera, or on digital image 
data obtained or created from other sources including cpmputer programs. However, 
it wiU be appreciated tbat the technique may be performed in other ways, and the 
invention is not restricted to the specific arrangements or applications described 
5 herein. 

The invention will further be described, by way of example, with reference to 
the accompanying drawings, in which: 

Figure 1 is an illustration prior to use of the image processing technique; 
Figures 2 and 3 illustrate steps of the image processing techniques; 
10 Figures 4 and 5 illustrate the processed form of the illustration of Figure 1; 

Figures 6 to 8 are further views illustrating the effect of the process; and 
Figure 9 is a diagram illustrating part of the process. 

The mvention will, initially, be desaribed with reference to the image 
illustrated in Figure 1. As can clearly be seen. Figure 1 is a computer generated or 

15 virtual reality representation of a vase 10, a cone 12, spheres 14 and cubes 16. As 
each of the objects illustrated are three-dimensional objects, the illustration uses 
isometric projections to provide depth cues to be interpreted by the brain in an attenqrt 
to make the objects appear to be an accurate represaatation of their form in three- 
dimensional space. Each object is isolated from all of the other objects, and no 

20 perspective cues to indicate the relative positions of the objects are present Asa 
result, it is difficult for the brain the interpret the image to determine, for example, the 
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relative sizes of tiie objects and their positions in three dimensional space. In the 
image, both of tiie cubes are dra^ as the same size and are perceived as being the 
same size despite one being further away than the other. 

In accordance with tiie invention, tiie base image of Figure 1 is processed to 
5 foim an image of improved fonn. This is achieved by taking tiie image of Figure 1 
and performing a transformation tiiereon whereby tiie image is stretched in tiie Y- 
direction (vertical) by a factor falling witiiin tiie range 2-7%, preferably abont 5%, is 
disordered and is rotated tiirough an angle felling witiiin tiie range 3-9° clockwise, 
preferably 6° clockwise. Figure 2 iUustrates tiie effect of tiie stretching and rotation 
10 oftiiemiage,but(forclaiity)nottiieimpactofdisarderingtiieimage. Theorderin 
which tiiese operations may be varied, but tiie values/factors used may need to be 
varied if the order is not as described. 

Anotiier copy of tiie image is stretched by a factor of 2-7% in tiie X-direction 
(horizontal). Preferably, it is stretched to ensure a differential witii tiie image in tiie 
15 previous transformation of around 5%. A fixation point on tiie image is selected, and 
an area around tiie fixation point is selected, tiie remainder of tiie image being deleted. 
The result of tiiis operation is shown in Figure 3, where tiie centire of tiie vase has 
been selected as the fixation point. 

The two images produced in tiiis manner are superimposed upon one anotiier. 
20 The images may be superimposed using several different techniques. Figure 4 
illustrates tiie effect of taking tiie hnage of Figure 2 and simply replacing an area 
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arouad the fixation point with the image of Figure 3 . Figure 5 illustrates the result of 
an alternative superimposition technique wherein the two images are overlaid and 
parts of both images are visible, the vase taking the form of a fused form. The 
fixation area is the vase; this comprises a combined form fused firom both image types 
5 1 and 2 in what at first seems an odd looking conjunction. However, when the centre 
of the vase is fixated, the two identities are merged by the brain into a single percept 
This percept is of a more three dimensional vase. This capacity for increased 3D 
percq)t is now extended to all the other objects in the picture. For example the 
fiartiier of the two cubes is now perceived to be larger than the closer cube. 

10 This percept of 3D form and depth is, in some ways, analogous to the percept 

obtained by perspective space. However, it is now thought that perspective cues are 
not the principle method by which spatial depth is obtained in central vision. Rather, 
we see spatial depth and form by a process that involves our visual system making 
relativistic judgements between two distinct data sets or image types. The 

15 arrangement identified above stimulates the brain to engage with this process when 
observing 2D space, providing us with cues more conversant with pur appreciation of 
real settings. 

The new picture space is closer to our actual visual appreciation of our 
surroundings. 

20 Referring next to Figures 6 to 8, an original digitised photograph of a real 
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settmgis shovminFigore 6. The key to forniing avalid composition is the selection 
of a fixation point and fixation area, and &e correct imposition of conditions 
prevailing in 'the fixation volume.' In the present case, the centre of the botde has 
been selected as the fixation point Figure 7 shows the effect of performing the 
transformations described hereinbefore, but omitting the disordering operation for 
clarity, and simply replacing the part of the image around the fixation point on one 
image with the relev^t part of the other image. Items within the fixation area, 
establishedround the fixationpoint, are represented as image type 2 with some of the 
associated quahtative and quantitative transformations. Outside the fixation area, all 
objects and smfaces are rendered as per image type 1 witiithe associated quatitative 
and quantitative transformations. As can be seen in Figure 7, the boundaiy 18 
between the two images in the merged image is clearly visible. Figure 8 illustrates flie 
result of a modified superimposition technique which removes or reduces the impact 
of the boundary between the images, and shows the estabUshment of the fixation 
volmne where all surfaces and objects not contained by tiie spherical influence of tiie 
fixation volume are also rendered as per image type 1. 

For example; round the neck of the botde the stones of the wall, although 
withinthe circumference of the fixation area of figure 7, are too far firom thebottle to 

t 

be included in the fixation volume and so are referenced as per image type 1. 

For example; one arm of the candelabra penetrates the fixation volmne and so 
is referenced as per image type 2 while the rest of the object is outside this area of 
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influence and so is rendered as per image type 1. 

By compaiing Figures 7 and 8 with Figure 6 it is apparent thai; in addition to 
the transfonnations mentioned hereinbefore, the image which has been stretched in 
liie Y-direction has also been modified by increasing tiielevel of colour saturation and 
5 reducing the brightness of the image. The colour saturation has been increased by an 
amount falling within the lange 20-60%, preferably about 40%^ andlhebrighmesshas 
been reduced by a factor falling within the range 10-50%, preferably about 30%. 

It is thought that images processed using tbe techniques described hereiabefore 
are of improved or increased resemblance to mental images projected by liie brain. 
10 Clear and accurate representation of mental image compositions allows an observer of 
the 2D rendition to engage in additional computations leading to a more viable 
perception of the real setting being depicted. 

An observer of the transformed image will need to look at (fijcate on) the 
selected fixation point to perceive/ appreciate the additional cues. 

15 In the description hereinbefore reference has been made to a step of 

disordering liie image. Altiiough a number of disordering techniques may be used, a 
preferred technique is to incrementally disorder the image using, for example, the 
sunflower-like fi^ctal pattern shown in Figure 9 to reduce the amount of detail visible 
in the processed image with increasing distance from the fixation point. 

20 If is thought that images processed using tbe techniques described hereinbefore 
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provide an improved or increased perception or mental proj ection of deplii to the part 
of tihe image around the fixation point The enhanced perception of depth is apparent 
both whereaviewer views the image through botii eyes and whenliie image is viewed 

using only one eye. 

5 Although the techniques have been described hereinbefore in relation to the 

processing of pictures, either in the form of computer generated pictures or 
photographs, it will be appreciated that this need not be the case and the invention 
may be applied to a wide range of technologies and display techniques including 
computer or television displays, projected images, virtual reahty displays, animations 

1 0 and printed media. 
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